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(54) Multi-objective optimization 

(57) In the field of multi-objective optimization using 
evolutionary algorithms conventionally different objec- 
tives are aggregated and combined into one objective 
function using a fixed weight when more than one ob- 
jective needs to be optimized. With such a weighted ag- 
gregation, only one solution can be obtained in one run. 
Therefore, according to the present invention two meth- 



ods to change the weights systematically and dynami- 
cally during the evolutionary optimization are proposed. 
One method is to assign uniformly distributed weight to 
each individual in the population of the evolutionary al- 
gorithm. The other method is to change the weight pe- 
riodically when the evolution proceeds. In this way a full 
set of Pareto solutions can be obtained in one single 
run. 
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Description 

[0001] The present invention relates to a method for the optimization of multi-objective problems using evolutionary 
algorithms as well as to a computer software program product for implementing such a method. 
5 [0002] The background of the present invention thereby is the field of evolution strategy. Therefore with reference 
to figure 1 at first the known cycle of an evolutionary algorithm will be explained. 

[0003] In a step 1 the object parameters to be optimized are encoded in a string called individual. A plurality of such 
individuals comprising the initial parent generation is then generated and the quality (fitness) of each individual in the 
parent generation is evaluated. In a step S2 the parents are reproduced by applying genetic operators called mutation 
10 and recombination. Thus, a new generation is reproduced in step S3, which is called the offspring generation. The 
quality of the offspring individuals is evaluated using a fitness function that is the objective of the optimization in step 
S4. Finally, depending on the calculated quality value, step S5 selects, possibly stochastically, the best offspring indi- 
viduals (survival of the fittest) which are used as parents for the next generation cycle if the termination condition in 
step S6 is not satisfied. 

is [0004] Before evaluating the quality of each individual, decoding may be needed depending on the encoding scheme 
used in the evolutionary algorithm. Note that the steps S2, S3, S4, S5 and S6 are cyclically repeated until the condition 
for termination of the optimization in step S6 is satisfied. 

[0005] The algorithm of this evolutionary optimization can be expressed by the following pseudo-code: 

20 t:= 0 

encode and initialize P(0) 
decode and evaluate P(0) 
do 

25 recombine P(t) 

mutate P(t) 

decode P (t) 

evaluate P (t) 

P(t+1) = select P(t) 
30 encode P(t+1) 

' t: =t+1 

until terminate 

35 [0006] Such evolutionary algorithms are known to be robust optimizers that are well suitable for discontinuous and 
multi-modal objective functions. Therefore, evolutionary algorithms have successfully been applied for example to 
mechanical and aerodynamic optimization problems, including preliminary turbine design, turbine blade design, multi- 
disciplinary rotor blade design, multi-disciplinary wing platform design and a military airframe preliminary design. 
[0007] Details on evolutionary algorithms can be found for example in Dasgupta et al. f "Evolutionary Algorithms in 

40 Engineering Applications", Springer-Verlag, 1997 and Miettinnen et al, "Evolutionary Algorithms in Engineering and 
Computer Science", John Wiley and Sons, 1999. 

[0008] In the framework of the present invention the evolutionary algorithms are applied to the simultaneous optimi- 
zation of multiple objectives, which is atypical feature of practical engineering and design problems. The principle of 
multi-criterion optimization is different from that in a single-objective optimization. In single-objective optimization, the 

45 goal is to find the best design solution, which corresponds to the minimum or maximum value of the objective function. 
On the contrary, in a multi-criterion optimization with conflicting objectives, there is no single optimal solution. The 
interaction among different objectives gives rise to a set of compromised solutions known as the Pareto-optimal solu- 
tions. A definition of Pareto optimal and Pareto front can be found in "Multiobjective evolutionary algorithms: Analyzing 
the state-of-the-art", DA Van Veldheizen andG.B. Lamont, Evolutionary Computation, 8(2), pp. 125-147, 2000. Since 

so none of these Pareto-optimal solutions can be identified as better than others without any further consideration, the 
goal in a multi-criterion optimization is to find as many Pareto-optimal solutions as possible. Once such solutions are 
found, it usually requires a higher-level decision-making with other considerations to choose one of them for imple- 
mentation. 

[0009] There are two objectives in a multi-criterion optimization: (i) find solutions close to the true Pareto-optimal 
55 solutions and (ii) find solutions that are widely different from each other. The first task is desired to satisfy optimality 
conditions in the obtained solutions. The second task is desired to have no bias towards any particular objective func- 
tion. 

[0010] In dealing with multi-criterion optimization problems, classical search and optimization methods are not effi- 
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cient, simply because (i) most of them cannot find multiple solutions in a single run, thereby requiring them to be applied 
as many times as the number of desired Pareto-optimal solutions, (ii) multiple application of these methods do not 
guarantee finding widely different Pareto-optimal solutions, and (Hi) most of them cannot efficiently handle problems 
with discrete variables and problems having multiple optimal solutions. On the contrary, the studies on evolutionary 

5 search algorithms, over the past few years, have shown that these methods can be efficiently used to eliminate most 
of the above difficulties of classical methods. Since they use a population of solutions in their search, multiple Pareto- 
optimal solutions can, in principle, be found in one single run. The use of diversity-preserving mechanisms can be 
added to the evolutionary search algorithms to find widely different Pareto-optimal solutions. 
[0011] A large number of evolutionary multi-objective algorithms (EM OA) have been proposed. So far, there are 

10 three main approaches to evolutionary multi-objective optimization, namely, aggregation approaches, population- 
based non-Pareto approaches and Pareto-based approaches. In the recent years, the Pareto-based approaches have 
been gaining increasing attention in the evolutionary computation community and several successful algorithms have 
been proposed. Unfortunately, the Pareto-based approaches are often very time-consuming. 
[0012] Despite their weaknesses, the aggregation approaches are very easy to implement and computationally ef- 

15 ficient. Usually, aggregation approaches can provide only one Pareto-solution if the weights are fixed using problem- 
specific prior knowledge. However, it is also possible to find more than one Pareto solutions using this method by 
changing the weights during optimization. The weights of the different objectives are encoded in the chromosome to 
obtain more than one Pareto solutions. Phenotypic fitness sharing is used to keep the diversity of the weight combi- 
nations and mating restrictions are required so that the algorithm can work property. 

20 [001 3] Most of the EMOAs take advantage of genetic algorithms and relatively less attention has been paid to evo- 
lution strategies. There are a small number of papers that use evolution strategies based on either the population- 
based non-Pareto or the Pareto-based approach. 

[0014] Therefore, it is the target of the present invention to develop a technique for a multi-objective optimization 
using evolutionary algorithms with a reduced computational effort. 
25 [0015] This target is achieved by means of the features of the independent claims. The dependent claims develop 
further the central idea of the present invention. 

[0016] To approximate the Pareto front instead of a single Pareto solution, the weight for each objective is changed 
systematically. One method is to distribute the weights uniformly among the individuals in the population. A further 
method is to periodically change the weights with the process of the evolution. Although these methods seem to be 

30 very simple, they have proved to be working effectively for two-objective optimization problems. Both methods work 
well on low-dimensional problems. However, for high-dimensional problems, the second method outperforms the first 
one. On the other hand, it also depends on the performance of the evolution strategy. The evolution strategy with 
Rotation Matrix Adaptation can give better performance than the standard evolution strategy. At the same time, the 
evolution strategy with Covariance Matrix Adaptation provides very good results on smooth, high-dimensional prob- 

35 | ems, but its performance degrades seriously on problems with discontinuous and non-convex Pareto-optimal front. 
[001 7] According to a first aspect of the present invention a method for the optimization of multi-objective problems 
using evolutionary algorithms is proposed. At first an initial population is set up as parents. Then the parents are 
reproduced to create a plurality of offspring individuals. The quality of the offspring individuals is evaluated by means 
of a fitness function. The fitness function is composed of the sum of weighted sub-functions that represent one of the 

40 objectives. Finally, the offspring individuals having the highest evaluated quality value are selected as parents. This 
cycle is repeated until an individual is found that has the prescribed quality. According to the present invention the 
weights for the sub-functions can be dynamically and systematically changed during the optimization process. 
[0018] According to a first embodiment the weights can be randomly redistributed among the different offspring 
individuals in each generation for each generation cycle. 

45 [0019] According to a second embodiment the weights can be changed periodically with the process of optimization. 
Thereby, each offspring can have the same weight in the same generation and the periodic change can have the shape 
of a sign function applied on the generation number. 

[0020] Pareto solutions found as optima) solutions for a multi-objective problem can be recorded in an archive. 
[0021 ] According to a further aspect of the present invention a computer software program product is proposed which 
so implements a method as set forth above when run on a computing device. 

[0022] Further advantages, features and objects of the present invention will become evident for those who are 
skilled in the art when reading the following description of an embodiment of the present invention taken in conjunction 
with the figures of the enclosed drawings: 

55 Figure 1 shows a cycle of an evolution strategy, 

Figure 2 shows the generation of periodically adapted weights of sub-functions of the fitness function, 
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Figure 3 shows a graphical representation of the periodically adapted weights of sub-functions of the fitness func- 
tion, 

Figure 4 shows the generation of uniformly and randomly distributed weights, and 

5 

Figure 5 shows a mathematical representation of the generation of uniformly and randomly distributed weights. 

[0023] In the standard evolution strategy, the mutation of the objective parameters is carried out by adding an N 
(0,o*) distributed random number. The step size 07 is also encoded into the genotype and subject to mutation. A 
10 standard evolution strategy can be described as follows: 
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x(/) = x(/-l)+z (1) 



o^r) =o£t -1) exp(r'z)exp(iz / ) (2) 

20 where x is an n-dimensional parameters to be optimized, z is an n-dimensional random number vector with z ~N 
(0.0(f) 2 ), z and z f are normally distributed random numbers with z, z, N(0, 1) r t f and o f are the strategy parameters, 
where o f is mutated as in equation (2) and r r r* are constants as follows: 

25 r={j2jh) A \^{j2n) A (3) 

[0024] There are several extensions to the above standard ES. In the present description an ES with Rotation Matrix 
Adaptation and an ES with Covariance Matrix Adaptation as well as the standard ES are used to show the effectiveness 
of the proposed multi-objective algorithms using different evolution strategies. 

[0025] Two main different selection schemes are available in evolution strategies. Suppose there are u. and X indi- 
viduals in the parent and offspring population, usually \i £ X. One selection method is to select the u. parent individuals 
only from the X offspring, which is usually noted as (ji, X)-ES. If the \i parent individuals are selected from a combination 
of the (i parent individuals and the X offspring individuals, the algorithm is noted as (ji + X)-ES. 
[0026] For the sake of clarity two objective problems are considered although they can be extended to problems with 
more than two objectives. For a conventional aggregation method, the fitness function is the weighted sum of the two 
different objectives: 

Fitness = iv,f, + wj 2 (4) 

where w 1 and w 2 are two constants determined using a prior knowledge about the problem. It is dear that by using a 
pair of fixed weights, only one Pareto solution can be obtained. 

[0027] If the algorithm is run so many times that every weight combination is exhausted, then every Pareto solution 
consisting of the Pareto front is obtained. Note that theoretically, Pareto solutions located in the concave region of the 
Pareto front can not be obtained by an aggregation method. However, it is unpractical to run the evolutionary algorithm 
so many times to exhaust all the weight combinations. Since population based optimization are used, advantage of 
the population is taken. If the different weight combinations can be distributed among the individuals, the population 
may be able to approach the Pareto front with the process of the evolution. 

Random Distribution of Weights within a Population 

[0028] Figure 2 shows a first embodiment for adaptivefy distributing weights. A uniform random weight generator 1 
generates in each generation t, t+t different weights 3 for the individuals 2 of each generation. Therefore for each 
generation t, t+t of the evolutionary optimization a number n of different weights is generated, wherein the number of 
weights corresponds to the number n of individuals 2 in each generation. 

[0029] In the following the first embodiment of the present invention will be explained: Suppose the (u., X)-ES is used, 
then the weight combinations can be distributed uniformly among the X individuals in the offspring population. Let 
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•Vj (0 = randofn{\ + 1) / X (5) 

5 4(0 = 10-^(0 (6) 

where #=1 , 2, ...X, t is the index for generation number, function random (k+ 1) generates a uniformly distributed number 
between 0 and X. In this way, one can get a uniformly distributed random weight combination (n^n^) among the 
individuals, where 0 £ , m£ £ 1 . 
10 [0030] This algorithm is also schematically represented in figure 3. Note that an individual may have a different weight 
combination in different generations. 

Generation-Based periodical Variation of the Weights 

* 5 [0031 ] Instead of the randomly distributed weight combination of the above first embodiment, according to a second 
embodiment of the present invention the use of a weight combination that is changed gradually and periodically with 
the process of the evaluation is proposed. 

[0032] Figure 4 shows schematically a structure for implementing said second embodiment of the present invention. 
As shown a periodic weight generator 4 generates different weights 5 for the different generations of individuals 2. 
20 However, all individuals 2 of the same generation use the identical weight 5 (in contrast to the first embodiment). 
[0033] This can be explained mathematically as follows: 
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w A (f) = \sm{2nt)/ R (7) 

^(0 = 1.0-^(0 ( (8) 

where f is the number of generation, M produces the absolute value of • One can see from equation (7) that wrft) 
changes from 0 to 1 periodically. Figure 5 illustrates this periodic (sine) evolution of the weights during the evolutionary 
optimization. Fis used to adjust the frequency of weight change. 

[0034] The results of the algorithm are not very sensitive to F, although it is reasonable to let the weight change from 
0 to 1 twice. Notice that in this case, all individuals have the same weight combination in the same generation. 

An Archive of Pareto Solutions 

[0035] In the algorithms explained above, the population is not able to keep all the found Pareto solutions, although 
it is able to approach the Pareto front dynamically. Therefore, it is necessary to record the Pareto solutions that are 
found so far. The pseudo-code for building the archive can be listed as follows: 

For each individual o in the offspring population 

If o dominates an individual in the parent population p, and 
if o is not dominated by any solutions in the archive, and 
if o is not similar to any solutions in the archive, and 

if the archive is not full, add o to the archive 

else if o dominates any solution in the archive a, replace a with o 

else if any solution a 1 in the archive dominates another solution a^ 

replace a 2 with o 

else discard o 



else discard o 
For each solution in the archive 
If solution a t dominates 
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remove ag 

[0036] The similarity is measured by the Eudidean distance in the fitness space. Note furthermore that a solution a 1 
is said to dominate the other solution a^ if both the following conditions are true: 

5 

1 . The solution a 1 is not worse than ^ in all objectives, and 

2. the solution a 1 is strictly better than in at least one objective. 

[0037] Many technical, industrial and business applications are possible for evolutionary optimization. Examples for 
10 applications can be found in Dasgupta et al., "Evolutionary Algorithms in Engineering Applications", Springer- Verlag, 
1997, and Miettinnen et al., "Evolutionary Algorithms in Engineering and Computer Science", John Wiley and Sons, 
1999. 



15 Claims 

1 . Method for the optimization of mutti-objective problems using evolutionary algorithms, the method comprising the 
following steps: 

setting up an initial population as parents (S1), 

reproducing the parents to create a plurality of offspring individuals (S2, S3), 

evaluating the quality of the offspring individuals by means of a fitness function (S4), wherein the fitness func- 
tion is composed of the sum of weighted sub-functions that represent an objective, the weights (5) for the sub- 
functions are changed dynamically (4) during the optimization, 

selecting the offspring(s) having the highest evaluated quality value as parents for the next evolution cycte(S5), 
characterized in that 

the weights (5) for the sub-functions are changed (4) periodically with the process of optimization 

30 2. Method according to claim 1 , 
characterized in that 

each offspring (2) has the same weight (5) in the same generation. 

3. Method according to anyone of the preceding claims, 
35 characterized In that 

the weights (5) for the sub-functions are changed (4) gradually between 0 and 1 with the process of optimization. 

4. Method according to claim 3, 
chatcterized in that 

40 the periodic change has the shape of a sine function applied on the generation number. 

5. Method according to anyone of the preceding claims, 
characterized In that 

Pareto solutions found as optimal solutions for a multi-objective problem are recorded in an archive. 

45 

6. Computer software program product, 
characterized in that 

it implements a method according to anyone of the preceding claims when run on a computing device. 

so 7. use of a method according to anyone of claims 1 to 5 for the optimization of aerodynamic bodies, wherein different 
objectives have to be taken into account, e.g. pressure loss and outlet angle calculated by a Navier-Stokes-solver 
and geometric constraints. 
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